Improving Anchoring Vignettes: Designing Surveys to Correct Interpersonal Incomparability
نویسنده
چکیده
We report the results of several randomized survey experiments designed to evaluate two intended improvements to anchoring vignettes, an increasingly common technique used to improve interpersonal comparability in survey research. This technique asks for respondent self-assessments followed by assessments of hypothetical people described in vignettes. Variation in assessments of the vignettes across respondents reveals interpersonal incomparability, allowing researchers to improve comparability by rescaling selfassessments relative to vignette responses. Our experiments show, first, that switching the question order so that self-assessments follow the vignettes primes respondents to define the response scale in a common way. In this case, priming is not a bias to avoid but a means of better communicating the question’s meaning. Second, we demonstrate that combining vignettes and self-assessments in a single direct comparison induces inconsistent and considerably less informative responses. Since similar combined strategies are widely employed for related purposes, our results suggest that anchoring vignettes could reduce measurement error in many applications where they are not currently used. Data for our experiments come from a national telephone survey and a separate on-line survey. Improving Anchoring Vignettes
منابع مشابه
Bonding, Bridging, and Linking Social Capital and Self-Rated Health among Chinese Adults: Use of the Anchoring Vignettes Technique
Three main opposing camps exist over how social capital relates to population health, namely the social support perspective, the inequality thesis, and the political economy approach. The distinction among bonding, bridging, and linking social capital probably helps close the debates between these three camps, which is rarely investigated in existing literatures. Moreover, although self-rated h...
متن کاملEnhancing the Validity and Cross-Cultural Comparability of Measurement in Survey Research
We address two long-standing survey research problems: measuring complicated concepts, such as political freedom and efficacy, that researchers define best with reference to examples; and what to do when respondents interpret identical questions in different ways. Scholars have long addressed these problems with approaches to reduce incomparability, such as writing more concrete questions—with ...
متن کاملImproving Vignette Descriptions and Question Formats to Measure Distance Vision: Evidence from Cognitive Interviews among Students in China
Vignette design has been largely neglected in anchoring vignette studies. This study aimed to contribute to the science of vignette design by developing and evaluating vignettes for measuring vision in rural China. Cognitive interviews were conducted among 36 participants in a Chinese middle school. The respondents either directly evaluated vision of the vignette character (i.e., noncomparative...
متن کاملComparability of Health Care Responsiveness in Europe using anchoring vignettes from SHARE
The aim of this paper is to measure and to correct for the potential incomparability of responses to the SHARE survey on health care responsiveness. A parametric approach based on the use of anchoring vignettes is applied to cross-sectional data (2006-07) in ten European countries. More than 6,000 respondents aged 50 years old and over were asked to assess the quality of health care responsiven...
متن کاملThe Heterogeneous Thresholds Ordered
Although surveys routinely ask respondents to evaluate various aspects of their life on an ordered scale, there is concern about interpersonal comparability of these self-assessments. Statistically, the problem is one of identification in ordered response models with heterogeneous thresholds. As a solution to the identification problem, King et al. (2004) proposed using anchoring vignettes, nam...
متن کامل